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Abstract 

Adaptive Markov Chain Monte Carlo (AMCMC) are a class of algorithms 
that have been recently proposed in MCMC literature. The main difference 
between MCMC and AMCMC is that, the tuning parameter, which deter- 
mines how fast the simulation converges to the desired distribution ip(-), is a 
function of the previous sample paths. This destroys the Markovian charac- 
ter of the chain. However it can be shown that, under some conditions, the 
adaptive chain converges to the target distribution ip. In this paper we use 
a diffusion approximation technique on a discrete time AMCMC. The result- 
ing diffusion, which is a two-dimensional degenerate one, gives some idea of 
the dynamics of the chain. The diffusive limits of a Standard MCMC is a one 
dimensional Ornstein-Uhlenbeck (OU) process. Using extensive simulations, 
we compare between Standard and AMCMC, in both discrete and continuous 
time settings, for various target distributions (both heavy and light tailed, 
symmetric and asymmetric). 

Keywords and phrases: MCMC, Adaptive MCMC, Diffusion approximation, 
tuning parameter, SDE. 
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1 Introduction 



MCMC is a class of widely used simulation algorithms used to generate sample from a 
distribution ip(-) known upto only a normalising constant. Such instances are numer- 
ous in the Bayesian literature ( see [1]). One member of this class is the Metropolis- 
Hastings (MH) algorithm which has gained widespread reputation since the work of 
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Metropolis and Hastings ([HUE])- Given ip upto a constant, the method involves 
choosing a proposal distribution q(x,y) from which samples are generated which is 
accepted using a MH acceptance probability given by min{l, gggg }. Under stan- 
dard assumptions, the sample thus generated is going to converge to the distribution 
ip(-) (for more details, see [22]). 

Since the algorithm involves a choice of q{x,y) (which depends on a parameter a) 
the time taken to converge to stationarity might be slow for bad choice of q(x, y) 
or er. Suggestions regarding the correct choice of a have been previously given in 
literature (see [7J, [6]). Another way of addressing this problem is by the use of 
Adaptive MCMC (AMCMC). Adaptive MCMC was first proposed by Haario et al 
[H] and since then there has been extensive research in this field (see [TJ [2J \W\ [T7] to 
name a few). The idea behind AMCMC is to make the scaling parameter a function 
of the previously generated samples and acceptance ratio (the ratio of the number of 
samples accepted to the number of samples generated), such that if the acceptance 
ratio is good then the scaling parameter can be increased. On the other hand if 
the acceptance ratio is not good then the scaling parameter should be decreased a 
little. Note that, it is not required that the sequence of scaling parameters converge 
to some quantity. Ideally this scheme is similar to the stochastic approximation 
framework (see [U [15]). However since the future value of the chain depends on 
the infinite past it is no longer a homogeneous Markov chain. The chain is called 
ergodic if the limiting distribution of the chain is the same as the target distribu- 
tion. Sufficient conditions for ergodicity is given by (i) the Diminishing Adaptation 
condition, which states that the the difference between successive transition kernels, 
defined using total variation norm, diminishes to 0, and (ii) Simultaneous Ergodicity 
condition , which says that the time to reach the invariant distribution is uniformly 
bounded over the tuning parameter. For more details see [17]. However, verifying 
the above conditions for a given AMCMC might prove to be difficult. 

In this paper we take the approach of embedding the discrete time chain in a contin- 
uous time process so that the limiting results of the resulting process can be studied. 
One advantage of this embedding is that the continuous time process can be studied 
via many discrete approximations (say Euler or Milstein,etc, which are asymptot- 
ically equivalent), whereas the discrete time chain can only be studied in the form 
it is specified. After embedding the discrete time AMCMC into a continuous time 
SDE. After embedding the discrete time AMCMC into a continuous time SDE we 
simulate it using the Euler approximation scheme. Also, for comparison purposes, 
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the standard (also called non-adaptive) MCMC is embedded in the same fashion 
and simulated using the same approximation scheme. 

In Section [2] we define the discrete time Adaptive chain and its diffusion approxima- 
tion. In Section [3] we derive the main theorem of this paper, where we obtain the 
limiting SDE. In Section H] we compare the standard and the adaptive MCMC by 
simulating the Euler discretization of the SDE derived in Section |3j Finally we end 
with some concluding remarks in Section Long derivation related to Theorem [T] 
is given in Appendix. 

2 Definition of the Adaptive MCMC model and 
its Diffusion Approximation 

First, let us define the algorithm which was proposed by Peter Green ( personal 
communication) : 

1. Select arbitrary {Xo, 6q, £o} G R x [0, oo) x {0, 1} where R is the state space. 
Set n — 1. 

2. Propose a new move say Y where 

Y ~ X(X n ,_ 1? n _i) 

3. Accept the new point with probability a(X n _i, Y) = min{l, ^pp-^j} 
If the point is accepted set X n = Y, £ n = 1; else X n = X„_i, £ n = 

4. e n = e n _ ie ^"- p) P > o & io g (0 n ) = io g (^_0 + j-fa - P ) P >o 

5. n n + 1 

6. Goto step 2. 

The above algorithm is equivalent to the following: 

1. Select arbitrary {X , 9 , £ } G R x [0, oo) x {0, 1}, where R is the state space. 
Set n — 1. 

2. Given X re _i, n _i, e n _i generate 



and then 

X n = X n _i + 6* n _i£ n e n _i 

where e„_i ~ N(0, 1), 

3. 6 n = e n ^e^"- p) ,p>0, «»log(0 n )=log(0 n _ 1 ) + ^ I (e„-p) ,p>0. 

4. n n + 1 

5. Goto step 2. 

Let us describe the algorithm. 9 n is the proposal scaling (tuning) parameter which 
is adaptively tuned depending whether the previous sample was accepted. If the 
sample was accepted then the proposal variance will increase allowing the chain to 
explore more regions in the state space. If the past sample was rejected then the 
variance will be small making the move a more conservative. Here p is a benchmark; 
for Normal target density this can be taken as 0.238, see[7]. This algorithm is 
somewhat similar in principle to the Stochastic approximation procedure, see 



Remark 1 We check for the Diminishing Adaptation condition given in We 
see that | log(# n+ i) — log(6* n )| ~ — > 0. So the diminishing adaptation condition is 
satisfied. 

We now proceed to embed the discrete time AMCMC into a continuous time SDE. 
For doing so we partition the half line [0, oo) into subintervals of length -. We apply 
the discrete time AMCMC at each points in the sub interval and then interpolate 
it continuously. We also impose a diminishing adaptation type condition on X n as 
well so that continuous embedding is posssible. The nth approximation X n {-) to 
continuous time process X(-) looks like: 



X n (0) = x GR; 
/ i + 1 \ / i \ 1 „ / i \ f i + 1 \ + 

x n ( — ) = xJ-) + — eJ-)U )ej ), i=0, 1, 



X n (t) = X n Q, ii^<t<^ for some integer i. (2.1) 
Here, £ n ( — ) conditionally follows the Bernoulli distribution given by: 



p(u—) = w L )M L Y<*C—) 

V n n v n / v n ' 



min-^ 



and {e n (^),n > l,i > 1 } are all independent N(0, 1) random variables. 
The nth approximation to the tuning parameter #(•) is defined as : 



i + l 

n 



e 


G R 








G) 










(-), 




n 



B n — = 9 n - - i=0 ,l, 



ager i. (2.2) 



Where p n {^) ~ 1 — ^7= for some p > 0. 

The discrete time Standard MCMC will be embedded in a continuous time where 
the nt/i approximation is given by: 

X n (0) = x G R; 

*n(— ) = X B (i) + ^=e e»(— )e„(— ), i=0,l,..,^R + , 

v n ' K n' \/n v n ' v n ' 



X n (t) = XJ-), if^<t<^ for some integer i. (2.3) 



where £n(^J has the same conditional distribution. The theorem in the next section 
deals with the diffusion approximation of the above AMCMC and standard MCMC. 

3 Main Theorem 

THEOREM 1 The limit of the process Y n (t) := \X n (t) n (*)); where X n (t) and 
9 n (t) is given by \2.1\ and \2.2\ respectively, is governed by the SDE: 



dY t = b(Y t )dt + a(Y t )dW t . (3.i; 



Where, 



6(Y ( ) = (— vt^t, B, (p 



2 i>(x t ) 1 " vs ii(Jf<; 



and 



0t 




and W f zs a iwo dimensional Wiener process. 
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Proof. 

Firstly, note that since Y n (^) := (X n (^) n (^)) is a homogenous Markov chain it 
defines a transition kernel 

n n (y, A) = P fy„(— ) G A|Y n (-) = y) Vy G R x R+ and VA G B(R x R+) 

The proof then follows essentially by obtaining the 'drift' and 'diffusion' coefficients 
of the discretised process and then finding its limit. Formally, first obtain the quan- 
tities : 

a„(y,t) := {a riji j(y,t)) i , =12 := n / (z - y)(z - y)'U n (y,dz), 
b„(y,t) := (b n>k (y,t)) k=12 :=n (z-y)Il n (y,dz). 

J R, 

Then find matrix a and vector b such that lim^oo ||a n (y,t) — a(y, = and 
lim^^oo | |b n (y, t) — b(y , t) \ | (where the norms are the usual matrix norm and vector 
norms respectively). Obtain the square root of matrix a(y, £)(say a(y,t)), which 
satisfies a(y,i) = a(y,t)a(y,t)'. If these coefficients define an SDE uniquely which 
is non-explosive, then the limiting process is governed by the equation: 

dY t = b(Y tj t)dt + a(Y t , t)dW t . 

where W t is a two dimensional Wiener process. For the processes defined in 12. II and 
12.21 the quantities a n (y,i) and b n (y, t) is (for y = (x 6) ): 

lim6 n , 2 (y,t) = 0(p_ ' 

lim a nl)1 (y,t) = 6 2 , 

lim a n ,2 j2 (y,0 = 0, 

lim a n2 ,i(y,t) = = lim a ni i j2 (y,t) 

See Section 17.11 for the derivations. 

Therefore ||a n (y,t) — a(y,£)|| — > and ||b n (y, t) — b(y, t)\ \ — > where 

/ \ ( 9 2 o\ . I 9 

a(y ' f) = (o o)^° M= { 

and b(y , t) = (*m Hp * 

This proves the theorem. 



2 VO) ' v 7 ^ ^(a: 
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Remark 2 Therefore, following the same proof as that of Theorem [1\ the SDE of 
the process corresponding to standard MCMC becomes 

ib'iX ) 9 2 

dX t = -77^TT^ + OdW t (3.2) 

In the next section we give extensive simulation for discrete and its diffusion ap- 
proximation comparing adaptive and non-adaptive methods. 

4 Comparison between Adaptive and Non- Adaptive 
MCMC by simulations 

In this section we compare both the discrete and continuous non adaptive MH 
sampler against its adaptive counterpart as proposed in SectionEl We try to simulate 
samples from target distributions with heavier and lighter tails compared to the 
Normal distribution. In the standard MH the tuning parameter is kept fixed. Since 
the tuning parameter that gives the best result is not known in general, so we 
compare the simulations for a host of 9 values. (Note that results relating to optimal 
p for Normal distribution is given in [7] which have been extended further in [3]). 

4.1 Comparison between the discrete time chains 

We generate the discrete time version of the adaptive and non adaptive sampler for 
different values of p and the starting 9. All the proposal distributions are normal 
and the target density is Normal(0,l) in Table HJ Cauchy(0,l) in Tableland t(2) 
in Table [3j After generating a sample of size 10000 we discard the first 1000 sam- 
ples as burn-in. To check the efficiency of the sampler we perform the one sample 
Kolmogorov-Smirnov (KS) test on the remaining sample and find the asymptotic 
p value of the KS test statistic D measuring the distance between the empirical 
distribution of the generated sample and the target distribution. 

Another measure of the amount of mixing is Expected Square Jumping Dis- 
tance(ESJD) defined as E(Xi — X^i) 2 . Based on the generated sample it can be 
estimated by ^gEiLB+ift — A^x) 2 , where B is the size of burn-in sample. In 
general, higher value of ESJD implies greater mixing. ( see [8] for more details). 
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See Tables [H HE] here. 



From Table ([l]) we see that the starting value of 0q = 2.38 is the best choice with 
respect to the Non-Adaptive chain as well as the Adaptive chain. This value of 9 
was suggested by Gelman et al ([7]). For adaptive chain the optimal value of p lies 
somewhere between 0.25 and 0.50. Again, by [7J, the optimal value of acceptance 
probability was close to 0.238. Therefore our simulations corroborates their findings 
to some extent. 

It is well known that the naive MH algorithm is not efficient enough in simulating 
from a heavy tailed distribution. This is what we see in Table ([2]) and Table ([3]). But 
we see that for the adaptive version withp lying in the same interval, ie in [0.25,0.50], 
its performance is at least better than that of its non adaptive counterpart, although 
by itself it is not quite efficient. 

In comparison we see that the continuous time version of the AMCMC performs 
much better than its discrete counterpart as elucidated in the next section. 

4.2 Comparison between the continuous time processes 

To comapre how fast the two SDEs 13.11 and 13.21 converge to stationarity we apply 
Euler discretisation to each of them for various choices of target density i/j and mesh 
size h. For the process I37T1 the Euler discretization is given by Xih, i — 0, 1, 2 . . . , ^ 
where: 

Y Y I u ^'jXifJ Qjh , ./In 7 (1) 

*(i + i)h - Xh + ri ^jT^\ ~Y vtlUlhZ ih 
0(i+i)h = Oih + h(9ih(p - Oih—^L)) , i = 0, 1, . . . ,T/h. 
Similarly the Euler discretisation for the process [3721 is {Yih\ where: 

Y {i+l)h = Y ih + h^^- 6 ^ + Vh0Z$, i = 0, 1, . . . , T/h, 6 = 6 eR + 

Where i = 0, 1, . . . , T/h, j = 1,2 are independent N(0, 1) random variables. 

For various values of the mesh size h we simulate 1000 parallel SDE using the Euler 
discretisation for the Adaptive and the Standard MCMC and obtain the value of 
Xt at time T = 1. Table HI Table (JSJ) and Table [6] gives the result when the target 
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distribution is N(0, 1), C(0, 1) and Exp(l) respectively. We also compute the Kol- 
mogorov Smirnov distance between the sample and the target distribution and also 
find its asymptotic p value. 

See Table H El |6] here. 

It should be noted that since the support of the Exponential density (Table E]) is 
only the positive part of the real line, while simulating the SDE corresponding to 
the distribution any move to the left of zero was modified accordingly 
The tables clearly indicate that for a proper choice of the parameter p, the Adaptive 
version performs better than the Non- Adaptive version. Almost always the asymp- 
totic p- value is small for smaller values of p it reaches its peak at an optimum p and 
then again decreases. The reason is that if p is small then the quantity — X^j \[2tx 
dominates p and 6^ decreases on the average. On the other hand if p is large then p 
dominates and 9ih increases in on the average. As a result the sample thus generated 
differs widely from the target density. 

Another table of interest is Table EJ Standard MCMC is not quite adept in sampling 
from a density with heavy tails. AMCMC to some degree addresses this problem 
where we see that the p-value is always higher for the Adaptive case for all values 
of mesh size h. 

5 Conclusion 

Diffusion approximation is a well studied technique that has been applied in many 
fields (e.g., [16], [5]). In AMCMC the tuning parameter changes as the iteration 
progresses and therefore the transition kernel also changes. As a result the invariant 
properties of the chain are not easily obtainable, even if the transition kernel at each 
iteration is stationary. In this paper, we have applied the diffusion approximation 
procedure to the AMCMC chain and obtained the limiting SDEs to arrive at the 
target distribution. Diffusive limits for Metropolis Hastings algorithm were earlier 
obtained in [201 [2TJ [18] . Also, there are some recent work on diffusive limits of high- 
dimensional non adaptive MCMC that came to the attention of the authors (for 
example, see [13] ). However, to the best of our knowledge, application of diffusion 
approximation to Adaptive MCMC and subsequent comparison between AMCMC 
and Standard MCMC using their respect diffusive limits have not been done earlier. 
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Our technique expands the scope of comparison between AMCMC and Standard 
MCMC, as embedding in continuous time allows various discrete approximations 
through which one can compare them in finer details. 

Some tasks awaits future research. First, the existence of the invariant distribution of 
the SDE has to be verified theoretically for different choices of the target distribution. 
Second, normal proposal in case of heavy tailed ip or multi modal densities is not 
always very efficient. Algorithms must be designed to handle such cases. It should 
be investigated whether combining the ideas of adaptivity and heavy tailed proposal 
increases the efficiency. There are some work in this area (see [H]). Third, although 
diffusion approximation simplifies the problem it does not say anything about the 
time to convergence of the chain. An interesting problem would be to bound the 
time taken to reach stationarity. For more information relating to bounding times 
of MCMC see [12] . We hope to take up these issues in our future research. 
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7 Appendix 

7.1 Drift and diffusion coefficients 

Writing y = (x 9) we have 

7.1.1 b n>1 



where A n (— A n (x,9)) is the set where ) is one with probability 1, i.e, 



6n,i(y,*) 



nE(X n (—) - X n (-)\ Y n (-) = y), Vz = 0, 1, . . . 

n n n 

E(^i9 n (-)U— K(— )l Y n (-) = y) 
n n n n 

y/ME{U-)en{-)\ Yn(-)=y) 



Vn > 1 




A n (x,9) 



{y- 



>i}. 



ijj(x) 
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Therefore, 



/ r r ^(x + 4-0e) 
b n ,i(y,t) = V^0( e<P(e)de+ -f^e^de 

= yfitiil e<P(e)de+ [ e<f>{e)de + [ e 2 0(e)rfe 



9 2 f(x) 



y/n 1p(x) Ja° 

I" 1 

/ e 3 (f)(e)de + 0(— ) J (By Taylor's expansion) 

n ip{x) Jac n ' 

= ede + -^^- I e^de + Oi 1 -)) 

= e^(e)de + 0(±) 

J ac, \/n 

V h i A ffiVWy [ 2, f^I-oo^de j£r//(x)>0 

e 2 tf/( x ) 



2 ijj(x) 



7.1.2 b 



71,2 



b n>2 (y,t) = n£(0 n (— )-0 n (-)|Y n (-) = y) Vi = 0,l,... 

n n n 

= «E(fl B (i){e^^^»-l}|Y B (i-)=y 
v n n 

= ^(^(e n (— )-Pn(-)|Y n (-) = y) 
v \/n n n n 

+ E(±(U—)-Pn(-)) 2 \Y n (-) = y) 

In n n n 

= 0V^(£n(— )-Pn(-)|Y re (-)=y) 

n n n 

+ ^((a(^)-Pn(-)) 2 )|Y n (l)=y) 
2 rt n n 

+ 0(-^).. 



Now, 



ev^E(^(— ) -p n ,(-)|Y n (-) = y) 
n n n 

9y/ZE{&C—)\Vn{-)=Y)-Pn{-) 

n n n 



I 



9M <j>{e)de + ^—^ e )de-p n , 

K JA n J Ac ip(x) n 
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^'(z) f , ,v 1 



= ^(l-p n (-)) + 2 ^ / e0(e)rfe + O(— ). (7.1) 

E((U—)-Pn(-)) 2 \Y n (-)=y) 
v n n n y 

£(«^) 2 |Y„(^ = y) - 2 P „(i)E(f„(i±i)|Y„(i) = y) + fc (i>» 

J -ri-n J A,, IL/KUs} I L J fin J -r^n i V\ %L '} 



, % . 

+ Pn{~, 

n 



2 



= (1 - p n (-)) 2 + ^(1 - 2p r X-))e^l f e<j>(e)de + 0(-). (7.2) 
Adding I7TT1 and I7T21 we have, 



+ o(i; 



Recalling that 1 - p n (i) « £ =}► ^(1 - 2p n (±)) « ^(2p - 1) we have, 



9 \ip'(x)l 



2tt ip{x) 



7.1.3 a.i,i 



an,i,i(y><) = ^ (*n( )-X n (-) 2 )\Y n (-)=y )Vz = 0,l, 

= n£(-£ n 2 e n 2 Y n - =y) 



n n n n 
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e 2 E(U—K(—) 2 \Y n (-) = y ) 

n n n 



jn 

lim a Hj i t i(t) = 9 2 .. 



e\E{U—)e n {—Yi An \ y„(-) = y) 

^a— K(— ) 2 /^i Y B (i) 

n n n 

err te + r 

K JA n J A* ip{x) 

9 2 ( [ e 2 de+ [ e 2 de + 0(- r 

e 2 + o{^=). 



7.1 A a n , 2 ,2 



an, 2 , 2 (y,t) = n£ )-0 n (-)) 2 |Y n (-)=y 
v n n n 

= n^k(^) 2 (e^^ ( ^ ) - p " ( ^ )) - l) 2 |Y n (^ 
v n n' 



ne 2 E({±(U—) ~ Pn(-)) + - ^(-)) 2 } 2 |Y„(-) = y 

v n n In n n n 

6 2 E({U—) ~ p n C-)) 2 \Y n {-) = y) + o(n) 
K n n n ' 



lim a n>2>2 {y,t) = 9 2 lim #((£„(—) - p n (-)) 2 |Y. 
= from El 



7.1.5 a nX 



a nil , 2 (y, t) nE({X n (^) - X n (-)}{9 n C—) - 9 n (-)}\Y n (-) = y) 

v n n n n n J 

ue{{ -L Sn( i) &( i±i )£ „(i±i) }{e „ ( i)(eA«-(¥)-p~(i)) )} ) 

v a/tt, n n n n 7 



\ n. n. ^/n. n. n. 



+ 



n n yjn n n 

In n n n > 

^fen(— )e„(— )-P»(-))|Y B (^)=y) 
v n n n n n ' 

+ 0{-=) fromO 
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Now, E(M—)e n (—)(U—)-Pn(-))\Y»( L )=y) 
v n n n n n ' 

= E(U fe n { Y B - = y 

v n n n ' 

- p n (-)E(U e n Y n - = y) 

n v n n n J 

= (l-p B (I))£(^(l±l) en (i±l)|Y n (i) =y) 

= (i-^l))E(u—M—)\Y»(-) = y) 

n v n n n ' 

= (1 "Pn(-))( / 60(6)^6+ / c ^ 

= (1- Pn (l))(/ e<P(e)de+ [ e <P(e)de + ^=^-9 [ e 2 <P(e)de 
n Wa„ J a* y/nip{x) Ja-„ 

+ 0(1)) 

= -^(l-Pn(-)))^/ 6 2 0(6)rf e + O(i) 

^ lim a„ 12 = a n o,i = 0. 

8 Tables 
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Adpative 




Non-Adapt 


ive 


9 


P 


D 


p- value 


E 


D 


p- value 


E 




0.10 


0.0502 


2.2e-12 


0.2388 










0.25 


0.0278 


1.729e-6 


0.6064 








0.10 


0.50 


0.0165 


0.01472 


0.7150 


0.1369 


2.2e-16 


0.00934 




0.75 


0.025 


2.702e-5 


0.3709 










0.10 


0.0391 


2.244e-12 


0.2587 










0.25 


0.0258 


1.199e-5 


0.5926 








0.25 


0.50 


0.024 


6.507e-5 


0.6971 


0.0377 


1.56e-ll 


0.05228 




0.75 


0.0273 


3.006e-6 


0.3618 










0.10 


0.0458 


2.2e-16 


0.2356 










0.25 


0.0186 


0.003867 


0.5835 








1.0 


0.50 


0.0168 


0.01270 


0.7137 


0.0251 


2.29e-5 


0.46209 




0.75 


0.0272 


3.344e-6 


0.3642 










0.10 


0.039 


2.46e-16 


0.2572 










0.25 


0.0138 


0.06627 


0.6050 








2.38 


0.50 


0.0153 


0.02883 


0.7070 


0.0223 


2.69e-4 


0.71047 




0.75 


0.0233 


0.00010 


0.3648 










0.10 


0.0467 


1.066e-14 


0.0427 










0.25 


0.0374 


2.38e-ll 


0.5953 








10 


0.50 


0.0221 


3.012e-4 


0.6988 


0.0302 


1.444e-7 


0.26411 




0.75 


0.0208 


0.00081 


0.3613 










0.10 


0.0467 


2.2e-16 


0.2433 










0.25 


0.0272 


3.42e-16 


0.5894 








20 


0.50 


0.030 


1.361e-7 


0.6992 


0.0669 


2.26e-15 


0.14603 




0.75 


0.0225 


0.002141 


0.3709 









Table 1: Table comparing the asymptotic p values of sample generated using 
AMCMC and MCMC for different values of p and 9 where the target density is 
Normal(0,l) 
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9 


P 


Adpative 
D p-value E 


Non- Adaptive 
D p-value E 


0.10 


0.10 
0.234 
0.50 
0.75 


0.0675 2.2e-16 34.8595 
0.0246 3.65e-5 10.6793 
0.0272 3.419e-6 2.9033 
0.0335 3.299e-9 0.7969 


0.2023 2.2e-16 0.00942 


0.25 


0.10 
0.234 
0.50 
0.75 


0.0582 2.2e-16 81.86962 
0.0389 2.79e-12 10.3054 
0.0186 0.00399 2.9030 
0.0385 5.29e-12 0.7305 


0.1069 2.2e-16 0.5468 


1.0 


0.10 
0.234 
0.50 
0.75 


0.0455 2.2e-16 34.8598 
0.0332 4.601e-9 10.7424 
0.0227 1.938e-4 2.9033 
0.0336 2.81e-9 0.7144 


0.0418 4.47e-14 0.6453 


2.38 


0.10 
0.234 
0.50 
0.75 


0.0675 2.2e-16 34.8598 
0.024 6.175e-5 11.0824 
0.0213 5.7137e-4 2.7663 
0.0353 3.646e-10 0.7490 


0.0302 1.493e-7 1.01557 


10 


0.10 
0.234 
0.50 
0.75 


0.0528 2.2e-16 34.8598 
0.0383 6.56e-12 10.0612 
0.0192 0.00258 2.8593 
0.0318 2.538e-8 0.7582 


0.0334 4.028e-9 10.19617 


20 


0.10 
0.234 
0.50 
0.75 


0.0529 2.2e-16 19.5438 
0.034 1.836e-9 10.4076 
0.0224 3.831e-5 2.8915 
0.0306 9.313e-8 0.7419 


0.0415 6.40e-14 22.9938 



Table 2: Table comparing the asymptotic p values of sample generated using 
AMCMC and MCMC for different values of p and 9 where the target density is 
Cauchy(0,l) 
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Adpative 


Non-Adapt 


ive 


9 


P 


D 


p- value 


E 


D p-value 


E 




0.10 


0.0605 


2.2e-16 


26.85993 








0.234 


0.0506 


2.2e-16 


10.28817 






0.10 


0.50 


0.0563 


2.2e-16 


2.8169 


0.1942 2.2e-16 


0.0094 




0.75 


0.0488 


2.2e-16 


0.7969 








0.10 


0.076 


2.2e-16 


81.86962 








0.234 


0.0717 


2.2e-16 


10.3054 






0.25 


0.50 


0.0504 


2.2e-16 


2.9030 


0.1365 2.2e-16 


0.0546 




0.75 


0.0436 


2.554e-15 


0.7305 








0.10 


0.0788 


2.2e-16 


23.0392 








0.234 


0.0641 


2.2e-16 


10.0612034 






1.0 


0.50 


0.0528 


2.2e-16 


2.9537 


0.0921 2.2e-16 


0.6253 




0.75 


0.0645 


2.2e-16 


0.7529 








0.10 


0.0675 


2.2e-16 


24.32133 








0.234 


0.024 


2.2e-16 


10.61035 






2.38 


0.50 


0.0559 


2.2e-16 


2.8804 


0.0652 2.2e-16 


1.9155 




0.75 


0.0398 


8.202e-13 


0.6986 








0.10 


0.0498 


2.2e-16 


24.6033 








0.238 


0.0576 


2.2e-16 


10.5307 






10 


0.50 


0.0489 


2.2e-16 


2.7374 


0.0566 2.2e-16 


10.1961 




0.75 


0.0483 


2.2e-16 


0.7206 








0.10 


0.0549 


2.2e-16 


24.7967 








0.234 


0.0565 


2.2e-16 


11.0529 






20 


0.50 


0.0557 


2.2e-16 


2.7514 


0.062 2.2e-16 


22.9938 




0.75 


0.0511 


2.2e-16 


0.7322 







Table 3: Table comparing the asymptotic p values of sample generated using AM- 
CMC and MCMC for different values of p and 8 where the target density is t(2) 
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p 


P 


value 


0{T) 




D 




Adaptive 


Non-Adaptive 




Adaptive 


Non-Adaptive 


h=0.0001 




1.0 


0.0385 




4.5900 


0.0444 




2.0 


0.2035 


0.5273 


0.0338 


0.0338 


0.0256 


2.5 


0.1415 




8.8963 


0.0364 




h=0.0005 




4.5 


0.4681 




12.8575 


0.0268 




5.0 


0.4774 


0.28 


14.4240 


0.0266 


0.0313 


5.5 


0.4186 




15.9708 


0.0279 




6.0 


0.2254 




17.50510 


0.033 


0.0313 


h=0.001 




4 


0.1999 




15.7125 


0.0305 




5 


0.3804 




14.0184 


0.02870 




5.5 


0.3409 




20.9751 


0.0297 




6.0 


0.4179 




17.6700 


0.0279 




6.5 


0.4393 


0.628 


18.9813 


0.0274 


0.0237 


7.5 


0.3369 




21.6681 


0.0298 




8.0 


0.2127 




23.0411 


0.0335 




h=0.005 




0.2 


0.2900 




2.4322 


0.0310 




0.5 


0.2595 




2.7888 


0.0319 




1.0 


0.1761 




3.5346 


0.0348 




1.5 


0.4378 


6.08e-10 


4.5760 


0.0275 


0.096 


2.0 


0.3782 




5.9303 


0.0288 




2.5 


0.2489 




7.3848 


0.0323 




3.0 


0.08535 




8.8085 


0.0397 




h=0.01 




1.0 


0.0033 




3.6390 


0.0565 




1.5 


0.0180 




5.0818 


0.0485 




2.0 


0.0977 





6.4826 


0.0388 


0.4516. 


3.0 


0.0347 




9.2409 


0.0450 





Table 4: Simulation of the SDE for Normal target desnity 
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V 


P 


value 


6(T) 




D 




Adaptive 


Non-Adaptive 




Adaptive 


Non-Adaptive 


h=0.0001 




1.5 


0.1885 




4.5917 


0.0344 




2.0 


0.4301 




5.5788 


0.0276 




2.5 


0.4880 


0.3641 


6.6407 


0.0264 


0.0291 


3.0 


0.3783 




7.7608 


0.0288 




20 


0.0507 




50.13257 


0.0429 




h=0.0005 




2.0 


0.02508 




5.5782 


0.0468 




2.5 


0.07267 




6.6402 


0.0407 




3.0 


0.1024 




7.7604 


0.0385 




3.5 


0.2379 




8.9240 


0.0326 




4.0 


0.7415 


0.6055 


10.1186 


0.0216 


0.0241 


4.25 


0.4527 




10.7244 


0.0271 




4.5 


0.04414 




11.3345 


0.0274 




h=0.001 




1.5 


0.6933 




4.5905 


0.0225 




2.0 


0.9175 


0.3688 


5.5774 


0.0176 


0.029 


2.5 


0.5089 




6.6394 


0.026 




h=0.005 




5.5 


0.328 




13.80297 


0.03 




6.0 


0.9579 


0.893 


15.0483 


0.0161 


0.0183 


6.5 


0.4649 




16.2972 


0.0269 




h=0.01 




6.0 


0.6368 




15.0477 


0.0235 




6.5 


0.9041 


0.4622 


16.2969 


0.0179 


0.0269 


7 


0.05136 


0.4622 


17.548 


0.0428 





Table 5: Simulation of the SDE for exponential target desnity 
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V 


P 


value 


6(T) 




D 




Adaptive 


Non-Adaptive 




Adaptive 


Non-Adaptive 


h=0.0001 




5 


0.2938 




18.13893 


0.0309 




7 


0.4407 


0.7756 


25.15494 


0.0274 


0.0209 


8 


0.3306 




27.8692 


0.03 




h=0.0005 




3.0 


1.10e-ll 




14.5622 


0.1139 




4.0 


0.07 




22.2738 


0.0409 




4.5 


0.1104 




26.3661 


0.0381 




6.0 


0.2259 


0.4709 


35.3313 


0.033 


0.0268 


7.0 


0.2022 




41.4020 


0.0338 




h=0.001 




0.5 


0.1423 




4.2115 


0.0363 




5 


0.168 




18.5107 


0.0352 




6 


0.2353 


0.4894 


21.3778 


0.0327 


0.0264 


7 


0.1641 




24.8888 


0.0354 




h=0.005 




2 


0.0356 




10.0997 


0.0457 




2.5 


0.0481 




9.9744 


0.0481 




3 


0.0824 




18.6841 


0.0399 




3.5 


0.1197 


1.652e-6 


24.7255 


0.0375 


0.0837 


4.0 


0.0627 




31.845 


0.0416 




h=0.01 




0.5 


0.0762 




3.8347 


0.0404 




1.0 


0.0162 




4.8314 


0.0491 




2.0 


0.0277 




8.1943 


0.0462 




2.5 


0.0060 




9.9910 


0.0539 




2.75 


0.0129 





10.7327 


0.0502 


0.1537 


3.0 


0.0079 




11.2480 


0.0526 




3.5 


0.0004 




12.9623 


0.06491 





Table 6: Simulation of the SDE for Cauchy target desnity 
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